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Abstract 

In this article, we present a geometric theoretical analysis of semidehnite feasibility problems (SDFPs). 
This is done by decomposing a SDFP into smaller problems, in a way that preserves most feasibility 
properties of the original problem. With this technique, we develop a detailed analysis of weakly in¬ 
feasible SDFPs to understand clearly and systematically how weak infeasibility arises in semidehnite 
programming. In particular, we show that for a weakly infeasible problem over n x n matrices, at most 
n — 1 directions are required to approach the positive semidehnite cone. We also present a discussion on 
feasibility certihcates for SDFPs and related complexity results. 


1 Introduction. 

In this paper, we deal with the following semidehnite feasibility problem 

max 0 s.t. X € {L + c) n Kn, (I) 

where L C S„ is a vector subspace and c € S„. By §„ we denote the linear space of n x n real symmetric 
matrices and Kn C §„ denotes the cone of n x n positive semidehnite matrices. We denote the problem (1) 
by {Kn,L,c). 

It is known that every instance of a semidehnite program falls into one of the following four statuses: 

• Strongly feasible: {L + c) Ci int (iC„) y 0, where int (iC„) denotes the interior of Kn- 

• Weakly feasible: {L + c)r\ int {Kn) = 0, but (L -|- c) fl Kn y 0. 

• Weakly infeasible: {L + c) Ci Kn = 0 and dist(Ar, L + c) = 0. 

• Strongly infeasible: (L 4- c) fl Kn = 0 and dist(A, L + c) >0. 

Among the four feasibility statuses, all but weak infeasibility afford simple hnite certihcates: an interior- 
feasible solution, a pair consisting of a feasible solution and a vector which is normal to a separating hyper¬ 
plane, and a dual improving direction for strong feasibility, weak feasibility and strong infeasibility respec¬ 
tively. The last one is sometimes called a Farkas-type certihcate, and plays an important role in optimization 
theory. However, it is not evident whether weak infeasibility affords such a hnite certihcate. 
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By “finite certificate” we mean a finite sequence in some finite dimensional vector space. In this paper, we 
focus on the structural analysis of weak infeasibility in semidefinite programming and develop a procedure 
which distinguishes the four statuses. We also obtain a finite certificate for weak infeasibility. But we 
emphasize that the main feature of our approach is concreteness in analyzing weak infeasibility. 

In view of finite certificates, we mention that it is possible to obtain a finite and polynomially bounded 
certificate of weak infeasibility by using Ramana’s extended Lagrangian dual [16]. This result is based on 
the fact that 

{Kn,L,c) is weakly infeasible if and only if it is infeasible and not strongly infeasible 

as we will discuss in Section 2. Ramana developed a generalized Farkas’ Lemma for SDP which holds without 
any assumptions. Since infeasibility and not strong infeasibility have finite certificates, the same is true for 
weak infeasibility. As this argument has an existential flavour, it is not so clear the implications for the 
structure of the problem. In this paper, we study weak infeasibility in semidefinite programming from a 
more constructive point of view to answer, for instance, the following basic question: 

Given a weakly infeasible SDFP, how can we generate a sequence G L + c, i = 1,. .. cxd} such 

that limi^oo dist(rt*^*\ =0? 

Due to the fact that the distance between Kn and L + c is zero, we readily see that there exists a nonzero 
element a in Kn H L. However, it is not clear how a is related to the weak infeasibility of (Ar„, L, c). Since 
the problem is infeasible, dist(fa + 6, Kn) > 0 for any t > 0 and b € L + c. It would be natural to ask what 
to happen as t goes to infinity. Can limt_^oo dist(ta + b, Kn) = oo or a finite nonzero value, or zero? If we 
cannot find any b G L + c such that limt_^oo dist(ta + 6, Kn) = 0 holds, how a can be used to construct points 
close to the cone? 

We will show that a alone is not enough to generate such a sequence, but (n — 1) directions including a 
are sufficient (with an appropriate choice of 6), whenever the problem is weakly infeasible. In other words, 
if {Km L, c) is weakly infeasible then there exists a (n — 1) dimensional affine subspace T C L + c such that 
if n Kn = 0 but dist(J^, Ar„) = 0. This result is a bit surprising to us, because, in general, if K is a closed 
convex cone and (K, L, c) is weakly infeasible, then the number of directions necessary to approach the cone 
could be as large as the dimension of L, which could be up to (SilLhli _ i) our context. 

The proof is done by constructing a set of directions in L which we call hyper feasible partition. These 
direction are obtained recursively starting from a nonzero element in Kn H L. An important feature of 
this set is that, even though each direction is not necessarily positive (semi)definite, we can always find a 
positive linear combination which is almost positive semidefinite (the minimum eigenvalue can be made to 
be arbitrarily close to zero). The introduction of hyper feasible partitions is another main contribution of 
this paper and they provide a new insight in the analysis of ill-conditioned semidefinite programs. 

One possible application of our results is as follows. Consider the following SDP 

max (&, x) s.t. X G {L + c)r\ Kn, (P) 

and suppose that the optimal value b* is finite but not attained. The set {x G L c \ {b,x) = 6*} is 
non-empty and is also an affine space. Denoting by i^the underlying vector space and letting c be any point 
which belongs to the affine space, we have that {Kn, L,c) is weakly infeasible. Indeed such problems arise in 
many applications in semidefinite programming including control theory and polynomial optimization [20] . 

The main tool we use is a simple decomposition result (Theorem 5), which implies that some semidefinite 
feasibility problems (SDFPs) can be decomposed into smaller subproblems in a way that the feasibility 
properties are mostly preserved. We also discuss two procedures for analyzing feasibility problems, a forward 
procedure (FP) and a backward procedure (BP). In particular, BP can distinguish the 4 different feasibility 
statuses in a systematic manner. 

We review related previous works. The existence of weak infeasibility/feasibility and finite duality gap 
is one of the main difficulties in semidefinite programming. These situations may occur in the absence of 
interior-feasible solutions to the primal and/or dual. Two possible techniques to recover interior-feasibility 
by reducing the feasible region of the problem or by expanding the feasible region of its dual counter-part 
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are the facial reduction algorithm (FRA) and the conic expansion approach (CEA), respectively. FRA was 
developed by Borwein and Wolkowicz [3] for problems more general than conic programming, whereas CEA 
was developed by Luo, Sturm and Zhang [14] for conic programming. 

In the earlier stages of research of semidefinite programming, Ramana [16] developed an extended 
Lagrange-Slater dual (ELSE) that has no duality gap. ELSE has the remarkable feature that the size 
of the extended problem is bounded by a polynomial in terms of the size of the original problem. In [17], 
Ramana, Tungel and Wolkowicz demonstrated that ELSE can be interpreted as a facial reduction problem, 
however, we should note that in the original FRA, the size of the problem is not polynomially bounded, 
see also [10]. In [12], Polik and Terlaky provided strong duals for conic programming over symmetric cones. 
Recently, Klep and Schweighofer developed another dual based on real algebraic geometry where the strong 
duality holds without any constraint qualification [5]. Like ELSE, their dual is just represented in terms of 
the data of original problem and the size of the dual is bounded by a polynomial in terms of the size of the 
original problem. Complexity of SEFP is yet a subtle issue. This topic was studied extensively by Porkolab 
and Khachiyan [13]. 

Waki and Muramatsu [21] considered a FRA for conic programming and showed that FRA can be 
regarded as a dual version of CEA. See an excellent review by Pataki [10] for FRA, where he points out the 
relation between facial reduction and extended duals. Pataki also found that all ill-conditioned semidefinite 
programs can be reduced to a common 2x2 semidefinite program [11]. Finally, we mention that Waki showed 
that weakly infeasible instances can be obtained from semidefinite relaxation of polynomial optimization 
problems [20]. 

The problem of weak infeasibility is closely related to closedness of the image of by a certain linear 
map. A comprehensive treatment of the subject was given by Pataki [9]. We will discuss the connection 
between Pataki’s results and weak infeasibility in Section 2. 

This paper is organized as follows. In Section 2, we discuss certificates for the different feasibility statuses 
and point the connections to previous works. In Section 3 we present Theorem 5 and discuss how certain 
SEFPs can be broken in smaller problems. We also prove the bound n — 1 for the number of the directions 
needed to approach Ar„. In Section 4, a procedure to distinguish between the 4 different feasibility statues 
is given. Section 5 summarizes this work. 


2 Characterization of different feasibility statuses 

In this section, we review the characterization of different feasibility statuses of semidefinite programs with 
emphasis on weak infeasibility. 

2.1 Certificates and NP class in the Blum-Shnb-Smale model 

Our main interest is on finite certificates and computational complexity. The model of computation we use 
is the Blum-Shub-Smale model (BSS model) [1] of real computation. The main aspects are that we do not 
care about the bit length of a real number, we can evaluate any rational function over R and the machine 
can deviate the flow of execution by evaluating a linear inequality. “Finite” in this context means that the 
certificates are composed of a finite number of vectors contained in some finite dimensional vector space. The 
length of the certificate is then the total number of coordinates among all the vectors it contains. It is also 
required that a verifier procedure exists. Such a procedure receives as input the problem and the certificate 
and attest that the certificate is indeed valid in a finite amount of time. If a decision problem admits a finite 
certificate with a verification procedure such that the length of the former and time complexity of the latter 
are polynomials in terms of the size of the problem then it is in N P under the BSS model. The main decision 
problem we are interested in is: given {Kn, L,c), what is its feasibility status?^ 

^Strictly speaking, a decision problem should have “yes” or “no” as answers, but in our case the possible answers are 
strong/weakly feasible, strong/weakly infeasible. We could have broken down the decision problem in 4 different decision 
problems having “yes” or “no” as answers. We did not do so, because we wanted to treat them in a unified manner in our 
procedure BP. 
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Suppose we have an algorithm for a decision problem which employs oracles for some problems, for 
instance, returning a feasible solution to a SDP. (This is a typical situation in the literature when talking 
about regularization procedures.) In such a situation, if we want to show that the decision problem is in 
NP, we can do the following. First, we prove that correctness of the output of each oracle can be verified 
in polynomial time (with respect the size of the problem). Then, we evaluate the time complexity of the 
algorithm assuming that the cost for each call of the oracle is one. If the running time of the algorithm is 
bounded by a polynomial in the size of the problem, then the decision problem is in NP. The set of outputs 
given by the oracles can be used as a certificate and the algorithm itself acts as a verifier procedure. 

Throughout this paper, we assume that L is represented as the set of solution of the system of linear 
equations, where the coefficients and left hand side is explicitly given. We also note that checking posi¬ 
tive semidefiniteness of a symmetric matrix can be done in polynomial time by using a variant of LDL^ 
decomposition. 

2.2 Characterization of feasibility statuses 

We start with the following proposition which characterizes strong feasibility, weak feasibility and strong 
infeasibility. 

Proposition 1. Let L be a subspace o/Sn and c G Sn then {Kn,L,c) is: 

1. Strongly feasible, if and only if there is x € L + c such that x is positive definite. 

2. Weakly feasible if and only if there is 

i. X G L + c such that x is positive semidefinite 
a. y G n Kn such that y ^ 0, {y, c) = 0. 

3. Strongly infeasible if and only if c ^ 0 and {Kn,Lsi,csi) is feasible, where Lsi = fl and 



Proof. Item i is immediate. Items ii. and Hi. follow easily from Theorem 11.3 and 11.4 of [18]. Item ii. 
correspond to the situation where Kn and L -I- c can be properly separated but still a feasible point exists 
and item in. to the case where they can be strongly separated. Also, for a proof of Hi. see, for instance. 
Lemma 5 of [15]. □ 

Proposition 1 already implies that deciding deciding strong feasibility, weak feasibility and strong infea¬ 
sibility are in NP, in the BSS model. In addition, (Ar„,L,c) is not strongly feasible if and only if item 2.H 
holds (but not necessarily 2.i). This means that deciding strong feasibility lies in coNP as well^. 

In Proposition 1, weak infeasibility is absent. When proving weak infeasibility, it is necessary to show 
that the distance between Kn and L -I- c is 0. The obvious way is to produce a sequence {xk} & L + c such 
that limfc^+oo dist(xfc, iL„) = 0. In [14] it was shown that {Kn,L,c) is weakly infeasible if and only if there 
is no dual improving direction and there is a dual improving sequence (see Lemma 6 and Table 1 in [14]). 
But this is not a finite certificate of weak infeasibility. 

A finite certificate for weak infeasibility can be obtained by using Ramana’s results on an extended La- 
grangian dual for semidefinite programming [16]. Ramana’s dual has a number of key properties: it is written 
explicitly in terms of problem data, it has no duality gap and the optimal value is always attained when 
finite. With his dual, it was possible to develop an exact Farkas-type lemma for semidefinite programming. 
In Theorem 19 of [16], he constructed another SDFP TZ'D{Kn,L,c) for which the following holds without 
any regularity conditions: 

{Kn,L,c) is feasible if and only if TZV{Kn, L, c) is infeasible. 

Furthermore, the size of TZV{Kn, L, c) is bounded by a polynomial that depends only on the size of the 
system (Kn, L,c). Based on this strong result, we obtain a finite certificate of weak infeasibility as in the 
following proposition: 

^In this case, the decision problem has either “yes” or “no” as possible answers, so it makes sense to talk about coNP. 
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Proposition 2. We have the following: 

i. {Km L, c) is weakly infeasible c 7 ^ 0 , TZ'D{Kn, L, c) and ^^{Kn, Lgj, csi) are feasible. 

ii. The problem of deciding whether a given is weakly infeasible is in NP D coNP in the BSS 

model. 

Proof. A feasible solution to TZT>{Kn, L,c) attests the infeasibility of (A"„,L,c). As TZT>{Kn,L^c) has poly¬ 
nomial size, it is possible to check that a point is indeed a solution to it in polynomial time. 

Note that a problem is weakly infeasible if and only if it is infeasible and is not strongly infeasible. 
Due to Proposition 1, we have that {KmL,c) is not strongly infeasible if and only if c = 0 or c 7 ^ 0 and 
TZVlKm Lsi,csi) is feasible. Hence, feasible solutions to TlV{Km L,c) and TZ'D{Kn,Lsi,csi) can be used 
together as a certificate for weak infeasibility. Such a certificate can be checked in polynomial time, hence 
the problem is in NP. 

Now, c = 0, a solution to {Km Dsp csi) or to {Km L, c) can be used to certify that a system is not weakly 
infeasible. This shows that deciding weak infeasibility is indeed in coNP. □ 

The important point in the argument above is having both a certificate of infeasibility for the original 
system and a certificate of infeasibility for the system (AT^, Lsij csi). Any method of obtaining finite certifi¬ 
cates of infeasibility can be used in place of TZV, as long as it takes polynomial time to verify them. See the 
comments after Theorem 3.5 in Sturm [19] and also Theorem 7.5.1 of [7] for another certificate of infeasibility. 
Klep and Schweighofer [5] also developed certificates for infeasibility and a hierarchy of infeasibility in which 
0-infeasibility corresponds to strong infeasibility and fc-infeasibility to weak infeasibility, when k > 0. Liu 
and Pataki [ 6 ] also introduced an infeasibility certificate for semidefinite programming. They defined what 
is a reformulation of a feasibility system and showed that (A'„,A,c) is infeasible if and only if it admits a 
reformulation that converts the systems to a special format, see Theorem 1 therein. 

We mention a few more related works on weak infeasibility. The feasibility problem (A"„, A, c) is weakly 
infeasible if and only if c € cl(Ar„ -|- A) \ (Ar„ -|- A), where cl denotes the closure operator. Hence, a 
necessary condition for weak infeasibility is that A'„ -P A fails to be closed. This problem is closely related 
to closedness of the image of Ar„ by a linear map which is the problem analyzed in detail by Pataki [9]. 
Theorem 1.1 in [9] provides a necessary and sufficient condition for the failure of closedness of Ar„ -P A. 
Pataki’s result implies that there is some c € Sn such that {Kn,L,c) is weakly infeasible if and only if 
L-^ n (cl dir (x, Kn) \ dir (x, A"„)) 7 ^ 0, where x belongs to the relative interior of A n Ar„ and dir (x, A'„) is 
the cone of feasible directions at x. This tells us whether Kn and A can accommodate a weakly infeasible 
problem. If it is indeed possible. Corollary 3.1 of [9] shows how to find an appropriate c. Bonnans and Shapiro 
[ 2 ] also discussed generation of weakly infeasible semidefinite programming problems. As a by-product of 
the proof of Proposition 2.193 therein, it is shown how to construct weakly infeasible problems. 

In [11], Pataki introduced the notion of well-behaved system. (A'n, A,c) is said to be well-behaved if for 
all 6 S S„, the optimal value of (P) and of its dual are the same and the dual is attained whenever it is finite. 
A SDP which is not well-behaved is said to be badly-behaved. Pataki showed that badly-behaved SDPs can 
be put into a special shape, see Theorem 6 in [11]. Then, a necessary condition for weak infeasibility is that 
the homogenized system (Ar„,A,0) be badly-behaved, where A is spanned by A and c. See the comments 
before Section 4 in [11]. 

3 A decomposition result. 

In this section, we develop a key decomposition result. Given an SDFP, we show how to construct a smaller 
dimensional SDFP which preserves most of the feasibility properties. 

3.1 Preliminaries 

First we introduce the notation. If C, D are subsets of some real space, we write dist(C,A>) = inf{||x — j/J] ] 
X € C,y G V}, where |j • jj is the Euclidean norm or the Frobenius norm, in the case of subsets of By 
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int (C) and ri (C) we denote the interior and the relative interior of C, respectively. We use /„ to denote the 
n X n identity matrix. Given {K^ L, c) and a matrix A G Kn H L with rank k, we will call A a hyper feasible 
direction of rank k. We remark that when {Kn, L, c) is feasible, A is also a recession direction of the feasible 
region. 

Let a; be a n X n matrix, and 0 < k < n. We denote by TT^fx). the upper left k x k principal submatrix 
of X. For instance, if 


X = 


1 2 3 \ 

2 4 5, 

3 5 6 / 


then. 


T^2{x) = 


1 2 
2 4 


We define the subproblem nk{Kn, L, c) of {Kn, L, c) to be 


find u G 'Xk{L + c), u ^ 0 . 


In other words, it is the feasibility problem ( 7 rfe(i^„), 7 rfc(L), 7 rfe(c)). We denote by Tfk{x), the lower right 
{n — k) X {n — k) principal submatrix. In the example above, we have t^ 2 {x) = 6 . In a similar manner, we 
write Tfk{Kn, L,c) for the feasibility problem {Tfk{Kn),^k{L),^k{c)). We remark that 7 r„(a;) = Tto{x) = x 
and we define 7 ro(a::) = Ttn{x) = 0 . 

The proposition belows summarizes the properties of the Schur Complement. For proofs, see Theorem 
7.7.6 of [4]. 

Proposition 3 (Schur Complement). Suppose M = (^ q ) is a symmetric matrix divided in blocks in a 
way that A is positive definite, then: 

• M is positive definite if and only if C — B"^A~^B is. 

• M is positive semidefinite if and only if C — B^A~^B is. 

The properties of a semidefinite program are not changed when a congruence transformation is applied, 
i.e, for any non-singular matrix P, we have that {Kn, L, c) and {Kn, PLP^, PcP"’") have the same feasibility 
properties, where PLP^ = {PIP^ \ I G L}. 


3.2 The main result 

It will be convenient for now to collapse weak feasibility and weak infeasibility into a single status. We say 
that {Kn, L, c) is in weak status if it is either weakly feasible or weakly infeasible. We start with the following 
basic observation. The proof is left to the readers. 

Proposition 4. If {Kn, L, c) is weakly infeasible, there exists a nonzero vector in Kn H L. 

Now we present a key result in our paper. The following theorem says that if {Kn,L,c) has a hyper 
feasible direction, then, we can construct another SDFP of smaller size whose feasibility status is almost 
identical to the original problem. 

Theorem 5. Let {Kn,L,c) be a SDFP, and consider a subproblem -Kk{Kn,L,c) for some k > 0. If the 
subproblem 'Kk{Kn, L,c) admits an interior hyper feasible direction (i.e, uA'Kk{Kn) C\'Kk{L) then: 

1. {Kn,L,c) is strongly feasible if and only ifT:k{Kn,L,c) is. 

2. {Kn,L,c) is strongly infeasible if and only ifTTk{Kn,L,c) is. 

3. {Kn,L,c) is in weak status if and only ifTtk{Kn,L,c) is. 
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Proof. Due to the assumption, there exists a. n x n matrix 


X = 


A 0 \ 
0 0 ) 


where A is a k x k positive definite matrix. 

We now prove items 1 and 2. Item 3 will follow by elimination. 

(1) =>) li y G L + c is positive definite, all its principal submatrices are also positive definite. Therefore, 
Tfk{y) is positive definite. 

(1) Suppose that y £ L + cis such that ^k{y) G int Then, we may write y = {^t q), where 

G is {n — k) X (n — k) and positive definite. For large and positive a, A + aA is positive definite and the 
Schur complement ot y + xa is G — E'^{F + aA)~^E. Since G is positive definite, it is clear that, increasing 
a if necessary, the Schur complement is also positive definite. For such an a, y + xa € (A + c) n int Kn- 

(2) ^). Suppose {Kn,L,c) strongly infeasible. Then there exists s G Kn such that s G and 

(s, c) = —1. As X € L, we have s G Kn H This means that s can be written as ([J ), where D belongs 

to Kn-k- It follows that 7fk{s) G Wk{L)-^ and (^fc(s), 7ffc(c)) = — 1. By item in. of Proposition 1, Tfk{Kn, L, c) 
is strongly infeasible. 

(2) <^=). Now, suppose ifkiKn, L,c) is strongly infeasible. Note that is a non-expansive map, i.e, 
\\^k{y) — ^kiz)\\ < IIj/— z\\ holds. In particular, if iniy^L^c,zGK„\\^k{y) — ^k{z)\\ > 0, then the same is true 
ioT iniy(zL+c,zGKj\y - z\\- □ 


3.3 Forward Procedure 

Assume that {Kn,L,c) admits a hyper feasible direction Ai of rank ki. Theorem 5 might not be di¬ 
rectly applicable but after appropriate congruence transformation by a nonsingular matrix Pi , we have that 
{Kn, P^LPi, P^cPi) admits a hyper feasible direction of the form 


Ai 


Ai 0 
0 0 


PiAiPi, 


where Ai is a /ci x ki positive definite matrix. The feasibility status of {Kn,L,c) and 

{Kn-k, , Tffc, (Pf LPi ), (Pf cPi ) ) 

are mostly the same in the sense that items 1 — 3 of Theorem 5 hold. 

Now, suppose that {Kn-k,,T^k,{Pi LPi),Tfk,{Pi cPi)) admits a hyper feasible direction A 2 of rank fc 2 - 
Then, after appropriate congruence transformation by P 2 , we obtain that 

{Kn-k, , P 2 ^k, {Pi PPl )P2, PiTTk, {Pi cPi )P2 ) 


admits a hyper feasible direction of the form 

A 2 0 \ 

0 0 y ’ 


where A 2 is /c 2 x k 2 positive definite matrix. 

Now, the feasibility status of {Kn-k,,^k,{PlLPi),^k,{PlcPi)) and 

{Kn-k,-k 2 , (pI{PI PPi)P2), {pI(PI PPi)P2)) 

are mostly the same. Note that instead of applying a congruence transformation by P 2 to 
{Kn-k,,^k,{PlLPi),Tfk,{PlcPi)), we can apply a congruence transformation by 


P 2 


Ik, 0 \ 
0 P 2 y 
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to the original problem {Kn, LPi, cPi), i.e., we consider 

(if„, Pi Pi LP,P 2 , Pi Pi CP1P2) 

Then the subproblem defined by the (n — ki) x (n — fci) lower right block matrix is precisely 

{Kr,-k, , Pink, (PiLPIP2,PITTk, [PiCPIP 2 ), 

and we may pick A 2 G Pi Pi LP 1 P 2 such that 


T^ki+klA2) 


I 2 0 \ 

0 0 y ■ 


Note that A 2 has the following shape 


A 2 


* * = 1 = \ 

=1= A2 0 j 
*00/ 


Generalizing the process outlined above, we obtain the following procedure, which we call “forward 
procedure”. The set of matrices {Ai,, Am} obtained in this way will be called a hyper feasible partition. 
After each application of Theorem 5, the size of the matrices is reduced at least by one. This means that 
after at most n iterations, a subproblem with no nonzero hyper feasible directions is found. At this point, 
no further directions can be added and we will say that the partition is maximal. 

We note that the problem of checking whether a SDFP {Kn, L, c) has a nonzero hyper-feasible direction 
lies in NP n coNP, in the real computation model. In fact, by Gordan’s Theorem, {Ka, L, c) does not have a 
nonzero hyper-feasible direction if and only if {Kn, ,0) is strongly feasible. 

[Procedure FP] 

Input: {Kn,L,c) 

Output: a non-singular matrix P, a sequence ki,... ,km and a maximal hyper feasible partition 




ii ■ 


_ \ / * * * \ 

Q j I ^2 = \^* A 2 oj 


A 2 — 


* ^3 

* 0 


and so forth, where Ai is positive definite and lies in Kk^, for every i. 


1. Set i := 1, L := L, c := c K := Kn, P '■= In- 

2. Find (i) Ai G L r\ K, tr(Ai) = 1 or (ii) B G fl intiF, tr(i?) = 1. (Exactly one of (i) and (ii) is 
solvable.) If (ii) is solvable, then stop. (No nonzero hyper-feasible direction exists.) 


3. Gompute a non-singular P such that. 


P'^A.P 


A 0 \ 
00 / 


where Ai is a positive definite matrix. Let ki := rank(Ai). 

4. Gompute M = and set P'^ := M'^P^. (If i = I, take M = P) 

5. Let Ai be any matrix in P^LP such that Tfki+...+ki-i{A) = P^AiP. For each 1 < j < i exchange Aj 
for M^AjM. 

6. Set L := 7rfe^(P^LP),c := rfklP'^'cP), K := itklKn), i := i + 1 and return to Step 2. (This step is 
just to pick the lower-right block after the congruence transformation.) 

Proposition 6. Suppose that {Kn, L, c) is such that there is a nonzero element in Kn H L. Applying FP to 
{Kn,L,c) we have that: 


1. {Kn,L,c) is strongly feasible if and only if 11 ^- 1 +...+k,n. {Kn,P'^LP,P'^cP) is. 

2. {KmL,c) is strongly infeasible if and only ifTtki+...+km{^rnP"^LP,P"^cP) is. 

3. {Kn,L,c) is in weak status if and only z/P^LP, P^cP) is weakly feasible. 

Proof. If m = 0, then the proposition follows because ttq is equal to the identity map. In the case m = 1, 
the result follows from Theorem 5. 

Note that at the i-th iteration, if a direction Ai is found then, after applying the congruence transfor¬ 
mation P, Tfki{K, P^LP, P^’^cP) preserves feasibility properties in the sense of Theorem I. Note that it is a 
SDFP over Sn-ki-...-ki- Also, due to the way M is selected, we have that equation tt *,. (PT, P^LP, P'^cP) = 
{Kn, P^LP, P^cP) holds after Line 4 and before L and K are updated. This justifies items I. and 

2 .. 

Consider the case where {Kn, P, c) is in weak status. When (PT, L, c) is weakly infeasible we can always 
find a new direction Ai and the size of problem decreases by a positive amount, so that {K,L,'c) cannot be 
weakly infeasible for all iterations. The only other possibility is weak feasibility, which justifies item 3. □ 


The matrices Ai,..., Am obtained through FP have the shape 


/ 

Ai 

0 

0 

0 ^ 


/ 

* 

* 

* 

* ^ 


/ 

* 

* 

* 

* \ 


0 

0 

0 

0 



* 

^2 

0 

0 



* 

* 

* 

* 


0 

0 

0 

0 

5 


* 

0 

0 

0 

5 


* 

* 

A3 

0 

V 

0 

0 

0 

0 y 


1 

* 

0 

0 

0 y 


1 

* 

* 

0 

0 / 


where Ai, A 2 , A 3 ,... are positive definite. The matrix Ai are referred to as sub-hyper feasible directions, 
since the Ai are hyper feasible directions. The problem Ttk^+...+k„{Km P^’^LP, P'^cP) will be referred to as 
the last subproblem of {Kn,L,c). 


Example 7. Let 



^ t 

V 

1 

V 

z 2 , 

V -\-l 

1 

V -\-l 

u — 1 

u \ 
z + 1 

s 

t, M, U, S, Z e M 

i 

\u 

z + 1 

s 

0 ^ 

> 


( 2 ) 


and let us apply FP to {K/^,L,c). The first direction can be, for instance, Ai = 
and P is the identity, at this step. At next iteration, we have K = K 3 and L = 
Then, A 2 can be taken as ( 0 ^ 0 ) ^2 *51. A possible choice of P is ( J ^ 0 ^. 


{( 


10 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
Z V z 
V u s 
z s 0 


Then ki = 1 
^ \ u, s,v, z G ]r| . 
Then P is 


10 0 0 
0 0 10 
0 10 0 
0 0 0 1 


and 


/o 0 0 i\ 

we can take A 2 = I q J [j q I. L is then updated and it becomes {(^ §) I - 2 ^ G • The procedure stops here, 
V 1 0 0 0/ 

because 0 is the only positive semidefinite matrix in L. 

Now, 7 r 2 (P^(P-|-c)P) *5 {(iXi ) I ^ ®}) 50 Tt 2 {Ki, P^LP, P"^cP) is a weakly feasible system. There¬ 
fore, by Proposition 6 , {K^, L, c) has weak status and is either weakly infeasible or weakly feasible. The 0 
in the lower right comer of ( 2 ) forces u = 0 , z = —1 and s = 0 , but this assignment produees a negative 
element in the diagonal. This tells us that {K 4 , L, c) is infeasible so it must be weakly infeasible. 


Corollary 8 . The matrices Ai,..., Am, P, B as described in FP together with a finite weak feasibility cer¬ 
tificate for Trki+...kmiBin, P"^ TP, P"'" cP) form a finite certificate that {Kn,L,c) is in weak status. If no such 
a certificate exists, then either item 1 or item 3 of Proposition 1 holds. This shows that deciding whether a 
SDFP is in weak status is in NP n coNP. 


Proof. Follows directly from Proposition 6 . 


□ 
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3.4 Maximum number of directions required to approach the positive semidef- 
inite cone 

According to Proposition 4 , there is always a nonzero element in Kn HA when {K^ L,c) is weakly infeasible. 
Therefore, a natural question is, given a weakly infeasible {Kn, L, c), whether it is always possible to select 
a point in X G A + c and then a nonzero direction d € Kn H L such that limt_,.+oo dist(x + td, Kn) = 0 or not. 
We call weakly infeasible problems having this property directionally weakly infeasible (DWI). The simplest 
instance of DWI problem is 

max 0 s.t. e K2, t gR. 

Unfortunately, not all weakly infeasible problems are DWI, as shown in the following instance. 

Example 9 (A weakly infeasible problem that is not directionally weakly infeasible). Let {K3,L,c) be such 

that L + c=l(ili] It, sG and let A, = ( 0 0 0 V 
IVsio/'’ J Vooo/ 

Applying Theorem 1 twice, we see that the problem is in weak status. Looking at its 2 x 2 lower right block, 
we see this problem is infeasible and hence is weakly infeasible. But this problem is not DWI. If {K^,L,c) 
were DWI, we would have limt_>_|_oo dist(tAi + c', K3) = 0 , for some c' G L + c. To show this does not hold, 
we fix s. Regardless of the value oft> 0 , the minimum eigenvalue of the matrix is uniformly negative, since 
its 2 X 2 lower right block is strongly infeasible. 

Thus, a weakly infeasible problem is not DWI in general. If we let s sufficiently large in the example, 
then the minimum eigenvalue of the lower 2 x 2 matrix gets very close to zero. This will make ( 1 , 3 ) and 
( 3 , 1 ) elements large. But we can let t much larger than s. Then, the minimum eigenvalue of the submatrix 
(* Q) is close to zero. Intuitively, this neutralize the effect of big off-diagonal elements, and we obtain points 
in L -f c arbitrarily close to K3, by taking s to be large and t to be much larger than s. 

Generalizing this intuition, in the following, we show that n — 1 directions are enough to approach the 
positive semidefinite cone. First we discuss how the hyper feasible partition {Ai ,..., Am} of FP fits in the 
concept of tangent cone. We recall that for x G Kn the cone of feasible directions is the set dir (x, Kn) = 
{d GSn I > 0 s.t X -I- td G Kn}. Then the tangent cone at x is the closure of dir (x, Kn) and is denoted by 
tanCone (x, Kn). It can be shown that if d G tanCone (x, Kn) then limt_>+oo dist(tx -I- d, Kn) = 0 . 

We remark that if x = ((j* q ), where D is positive definite kxk matrix, then tanCone (x, Kn) consists of all 
symmetric matrices {Z e), where * denotes arbitrary entries and A is a positive semidefinite {n — k)x{n — k) 
matrix. See [8] for more details. 

The output {Ai ,..., Am} of FP is such that A2 G tanCone (Ai,Kn). This is clear from the shape of Ai 

and A2, and from a simple argument using the Schur Complement. Now, A3 is such that Trki+k2{^3) is posi- 

( ****\ 

* 0 0 ) ^3 “ ( * * A3 0 ) ■ Then 

=t=000x \=(:=t:00x 

i.e, Ttki{A3) G tanCone (7ffe^(A2),Ar„_fcJ. Denote ki + ... + ki by W and set Nq = 0 . Then, for i > 2 , we 
have: 


(* A3 o') G tanCone (( i"" 0 0 ) , Kn-ki), 
0 0 / VVoooz / 


^Ni^ 2 (A) G tanCone(7rjVi„2(^i-i)> 

Moreover, if the last subproblem Ttj,f^{Kn, L,c) has a feasible solution, we can pick some c' such that 
^Vm(c') is positive semidefinite. Then TfNn,-i{c') G tdAiCone{jfNn,_ 3 {Am),Kn-Nn,-i)- Given e > 0, by 
picking > 0 sufficiently large we have dist(7fAr,„_i (c'-b ttmAm), Ar„_jv„_j) < e. Now, (x-I-amAm) 

does not necessarily lie on the tangent cone of TrN.„,_ 2 {Am-i) at Kn-N„i- 2 ^ bat still it is possible to pick 
Oim-i > 0 such that 

dist(7r7V„i_2 (^ A CymAm Cym — lAm — l),Kn—Njn — 2) ^ 

In order to show this, let h G Kn-N^-i be such that 

II —1 (e “b ^mAm ) h\\ — dist (7r7V„i_i (c -b eXmAm) , Kn—Nm — 1 ) ■ 
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Now, define h to be the matrix 7 rAr^_ 2 (c' + am^m), except that the lower right (n — km) x (n — km) block 
is replaced by h. It follows readily that h lies on the tangent cone of 7 fjv^_ 2 (Am-r)- Then, we may pick 
am-i > 0 sufficiently large such that dist('^Ar,„_ 2 + h, Kn-N,n- 2 ) < Let yi = + am^m), 

y 2 = ^Afm- 2 (o;m-i^m-r)- We then have the following implications: 

dist( 2 /i +y 2 ,Kn-N^. 2 ) < dist(?/i - h,Kn-N^. 2 ) + dist(i /2 + h,Kn-Nm- 2 ) 

— Ctm-^m) ~ h\\ + € < 2e. 

If we continue in this way, it becomes clear that oi,..., am can be selected such that dist(c' + am Am + 
am-iAm-i + ... + aiAi,Kn) < me. This shows how the directions {Ai, ..., Am} can be used to construct 
points that are arbitrarily close to A"„, when the last subproblem is feasible. This leads to the next theorem. 

Theorem 10. If {Kn, L, c) is weakly infeasible then there exists an affine space of dimension at most n — 1 
such that L' + c' Q L + c and (Kn, L\ c') is weakly infeasible. 

Proof. The construction above shows that if L' is the space spanned by {Ti,... ^Am} and c! is taken as 
above, then (A'„, A', c') is weakly infeasible. As (Kn, L, c) is weakly infeasible, we have m > 0. We also have 
ki + ... + km < n, which implies m < n. Notice that TtniKn^ LP^ cP) is strongly feasible, because it 
is equal to the system ({0}, {0}, 0). Therefore ki + ... + km < n, which forces m <n. □ 


4 Backward Procedure 


In this section, we discuss a “backward procedure” for distinguishing the 4 different feasibility statuses. The 
main difficulty is when the problem is in weak status. In that case, due to Proposition 6 , the last subproblem 
is weakly feasible. This offers the opportunity to shrink both the last subproblem and the whole problem, 
as discussed in our next theorem. 


Theorem 11. Let {Kn,L,c) be a given SDFP, satisfying the following assumptions: 

1. for some k > 0, Tfk{Kn, L, c) is weakly feasible. 

2. for some I such that 0 < I < n — k, the face F = {(^g)|A€ Ki} contains the feasible region of 
nk{Kn,L,c). 



Furthermore, let E he the set of (k + 1) x (k + 1) upper left principal submatrices in §„, i.e., E = 
{(^ 0) I ^ ^ define L and c as the vector subspace and a vector such that E D {L + c) is equal to 

L + c, i.e., 


E n (A ~t“ c) — L F c — 


nk+i{L + c) 

0 



0 

0 

0 

0 


( 3 ) 


i—k—l 


(L + c is an affine subspace of L + c where all hut the upper left block is set to zero.) 

Then, the following holds: If (3) is empty, {Kn,L,c) is infeasible. Otherwise, (Ar„,A, c) is feasible if and 
only if the SDFP subproblem 7 rfe_|_/(Ar„, A, c) is feasible. 
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Proof. Due to assumption 1, IrkiKn, L,c) is weakly feasible, so if a; G L + c and Tfk{x) is positive semidefinite 
then X has the format (* where C is a (n — fc) x (n — fc) positive semidefinite definite and * denotes 
arbitrary entries. Now, due to Assumption 2, C itself has the format (^g), where C is a / x / positive 

* C 0 ). 

*00/ 

In order for x itself to be positive semidefinite, the elements in the upper right and lower left must be 

* C 0 j , where {I c) is a, {k + 1) x {k + 1) positive semidefinite 
matrix. Therefore, if A n (L + c) =0 there is no way (Ar„, L, c) could be feasible. 

li Efi{L-\-c) is not empty, since Hk+i (a^) = ( * c) i is clear that the feasibility of {Kn ,L,c) is equivalent 
to the feasibility of TYk+i{Kn, L^c). □ 

We remark that whenever [Kn,L,c) satisfies Assumption 1 , it is possible to apply a congruence trans¬ 
formation to {Kn,L,c) in order to meet Assumption 2. Using Theorem 11.3 of [18], the weak feasibility of 
7fk{Kn, L, c) implies the existence of re / 0 such that {w,TTk{l -f c)) < {w, x), for every I G L and x G Kn-k- 
The only way this inequality can hold is is if w G Kn-k n7ffe(T)-*- and {w,Tfk{c)) < 0. As Tfk{Km L,c) is 
not strongly infeasible, we have {w^Trk{c)) = 0. Changing L + c and w by a congruence transformation if 
necessary, we may assume that = (g ~), where w is a {n — k — 1) x (n — k — 1) positive definite matrix and 
I < n — k. Then, it is clear that Assumption 2 holds for the transformed problem. 

The search for a w as above is essentially one step of a facial reduction algorithm [3, 10, 21]. Each 
iteration of a facial reduction algorithm aims to find a proper face of Kn that still contains the feasible 
region. Usually, however, the search is done on the whole problem. Let w' = (g [i), where w' G Kn, then 
w' G Kn n n {c}^. Which means that w' can be used to perform a step of facial reduction on the whole 
problem. In particular, if a; is a feasible point, since {x,w) = 0, it must be true that x = ('[]’ g), where 
D is a positive semidefinite (fc -|- Z) x (fc -|- 1) matrix. The idea is that the knowledge of a weakly feasible 
subproblem makes it possible to confine the search to a smaller subproblem and still find a smaller face of 
Kn that contains the feasible region of the original problem. 

If we apply Theorems 5 and 11 repeatedly, we obtain a facial reduction-like procedure which is able to 
determine the feasibility status of a given {Kn, L, c) as shown below. 

[Procedure BP] 

Step 1. Apply FP to {Kn,L,c). If the last subproblem (Ar„, P^LP, P^cP) is strongly infeasible, 

then {Kn,L,c) is also strongly infeasible. If 7rfej+..._|_fc„ (Ar„, P^PP, P’^cP) is strongly feasible, then 
{Kn,L,c) is also strongly feasible. In both cases we stop the procedure. Otherwise set i = 0,Po = 
Kn, Lq = L,co = c. 

Step 2. If we reach this step, (Pi, P^PiP, P^CiP), is weakly feasible, i.e., {Fi,Li,Ci) is in weak 

status. Applying a congruence transformation to {Fi,P'^LiP, P^aP), if necessary, both assumptions 
of Theorem 11 can be met. Let Kk+i, P, c and F be as in Theorem 11. If P n P'^{Li + Ci)P is 
empty, we stop and declare {Kn, P, c) to be weakly infeasible. Otherwise, we obtain P -|-c such that 
F n P^{Li + Ci)P = L + c and a projection nk+i- 

Step 3. Apply FP to TTfc+i(Pi, P,c) and obtain a new projection . If 7ffe^+...+fc^(A'fc+i, 7rfe+;(P), 7rfc+i(c)) 

is strongly feasible, then {Kn,L,c) is weakly feasible. liTTki+...+km{Kk+i,'^k+i{L),TTk+i(fc)) is strongly 
infeasible, then {Kn,L,c) is weakly infeasible. In both cases, we end the procedure. Otherwise, set 
Pi+i := Kk+i, Li+i := 'Kk+i{L), Ci+i := nk+i{c), i := i + 1 and return to Step 2. 

Remark: The procedure terminates in at most n iterations, because the size of the problem is reduced at 
least by one for each iteration. 

Example 12. Let L and c be as in Example 7 and let us apply BP to {Ki,L,c). At Step 1, we apply to FP 
and we obtain If 2 {P"^{L + c)P) = {{^'^.f \ zGM}. And 7f2(Ar4 , P^PP,P^cP) is weakly feasible, so we 

move on to Step 2. The feasible region ofTf 2 {Ki,P"^LP,P"^cP) consists of a single matrix which is (g g). 
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We are under the conditions of Theorem 11 and 


Er\P'^iL + c)P 



/ 1 

1 

V 


1 


1 

-1 

V + \ 

0 

t, z; G R 


V 

n + 1 

1 

0 



0 

0 

0^ 

J 


Then 713 (L+c) = |( 1 ^ 1 ^ I ^ Applying FP to {K^,ttm{,L),ttm(c)) we obtain as output P = I 3 , 

m = 1, ki = 1 and Ai = ( 000 ^. Then 7fi(7r3(L + c)) = {( ) | € R}. The —1 in the upper left 

entry ensures that the system (A" 2 , 711 ( 773 (L)),7fi(7r3(L))) is strongly infeasible, which shows that {Ki,L,c) 
is weakly infeasible itself. 


4.1 Complexity aspects of BP 

Let us discuss briefly certificates and complexity issues regarding BP. Both BP and FP can be thought 
as procedures that invoke several oracles. For instance, we can consider that a nonzero hyper feasible 
direction, as required in FP, is obtained by querying an oracle. According to the recipe explained in the 
second paragraph of Section 2.1, we can show that the problem of deciding the feasibility status of (Ar„, L, c) 
has a finite certificate and that BP acts as as verifier procedure. All we have to do is argue that all the 
computations required by BP can be checked in polynomial time. 

First note that all computations done by FP can be checked either by the certificates discussed in 
Proposition 1 or by Gordan’s Theorem. The same is true for Steps 1 and 3 of BP. The only part of 
BP that needs further analysis is when Theorem 11 is invoked at Step 2, where we need to check that 
assumption 2 of Theorem 11 holds. However, we can use as certificate a nonzero element w satisfying 
w G Fi n (P^^LiP)^ n {P^CiP}-*-, as in the discussion that follows the proof of Theorem 11 and, if necessary, 
a non-singular matrix which puts the problem in the correct shape. 

This provides an alternative proof of the fact that for each different feasibility status, the problem of 
deciding whether {Kn,L,c) has that status is in NP n coNP in the BBS model of real computation. 


5 Conclusion 

In this article we presented an analysis of weakly infeasible problems via two procedures: FP and BP. The 
procedure FP produces as an output a finite set of directions and for weakly infeasible problem, they can 
be used to construct L + c arbitrarily close to Kn- The procedure BP uses FP and is able to distinguish 
between the four feasibility statuses. The computations involved in both procedures might be hard, but they 
are verifiable in polynomial time, in the BSS model. Extension of our analysis to blockwise SDPs and to 
other classes of conic linear programs is an interesting topic for future research. 
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